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In this article, the Moderate Resolution Imaging Spectroradiometer (MODIS) 
Bidirectional Reflectance Distribution Function (BRDF)/Albedo product (MCD43) is 
evaluated over a heterogeneous agricultural area in the framework of the Earth 
Observation: Optical Data Calibration and Information Extraction (EODIX) project 
campaign, which was developed in Barrax (Spain) in June 2011. In this method, 
two models, the RossThick-LiSparse-Reciprocal (RTLSR) (which corresponds to 
the MODIS BRDF algorithm) and the RossThick-Maignan-LiSparse-Reciprocal 
(RTLSR-HS), were tested over airborne data by processing high-resolution images 
acquired with the Airborne Hyperspectral Scanner (AHS) sensor. During the campaign, 
airborne images were retrieved with different view zenith angles along the principal and 
orthogonal planes. Comparing the results of applying the models to the airborne data 
with ground measurements, we obtained a root mean square error (RMSE) of 0.0 1 8 with 
both RTLSR and RTLSR-HS models. The evaluation of the MODIS BRDF/Albedo 
product (MCD43) was performed by comparing satellite images with AHS estimations. 

The results reported an RMSE of 0.04 with both models. Additionally, taking advan- 
tage of a homogeneous barley pixel, we compared in situ albedo data to satellite albedo 
data. In this case, the MODIS albedo estimation was (0.210 ± 0.003), while the in situ 
measurement was (0.204 ± 0.003). This result shows good agreement in regard to a 
homogeneous pixel. 


Introduction 

Land surface broadband albedo is a critical land physical parameter affecting the Earth’s 
climate. It is well recognized that surface albedo is among the main radiative uncertain- 
ties in current climate modelling. In fact, an absolute accuracy of 0.02-0.05 is required 
for albedo characterization at spatial and temporal scales compatible with climate studies 
(Sellers 1993). The increasing spatial resolution of modern climate models makes it nec- 
essary to examine the spatial features of global surface albedo. Satellite remote sensing 
provides the only practical way of producing high-quality global albedo data sets with high 
spatial and temporal resolution. 

The Moderate Resolution Imaging Spectroradiometer (MODIS) on board the Terra and 
Aqua satellites provides near-global earth observations on a daily basis, with fine spec- 
tral and spatial resolution (Barnes, Pagano, and Salomonson 1998). The availability of 
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MODIS products is supposed a great advance as these products are widely used by the 
scientific community with different purposes as, for example, the evaluation of deforesta- 
tion (Ferreira et al. 2007), estimation of evapotranspiration (Mu et al. 2007), and studies 
on snow cover (Pu, Xu, and Salomonson 2007). The MODIS Bidirectional Reflectance 
Distribution Function (BRDF)/ Albedo product, MCD43 (Strahler et al. 1999), combines 
registered, multidate, multiband, atmospherically corrected surface reflectance data from 
the MODIS and Multi-angle Imaging Spectroradiometer (MISR) instruments to fit a BRDF 
in seven spectral bands at 1 km spatial resolution on a 16 day cycle. From this charac- 
terization of the surface anisotropy, the algorithm performs angular integrations to derive 
intrinsic land surface albedos for each spectral band and three broadbands covering the 
solar spectrum. However, in this article, we work directly with the MCD43A1 product, 
which contains three-dimensional (3D) data sets providing users with weighting parame- 
ters for the models used to derive the Albedo and BRDF products. Both Terra and Aqua 
data are used in the generation of this product, providing the highest probability for quality 
input data and designating it as an MCD, meaning combined product. 

The validation of this product has been studied in previous works. Jin et al. (2003) 
evaluated the accuracy of the MODIS albedo product using only observations from the 
MODIS instrument aboard the Terra platform and over homogeneous regions at local solar 
noon. They found that the MODIS albedo product met an absolute accuracy requirement 
of 0.02 in spring and summer, identifying these as the growing seasons. However, dur- 
ing the winter season, they observed lower albedo estimations than the field values. Liang 
et al. (2002) validated the MODIS black-sky albedo product, scaling up the ground mea- 
surements to MODIS resolution using high-resolution Enhanced Thematic Mapper Plus 
(ETM+) imagery. In this work, the authors considered that the surface is Lambertian, so 
the retrieved surface reflectance of different spectral bands is equivalent to surface spectral 
albedos. Despite this approach, the comparison showed good agreement. Roesch, Schaaf, 
and Gao (2004) compared MODIS albedo at 0.05° with in situ measurements collected at 
Baseline Surface Radiation Network sites during snow-free periods. The results showed 
good agreement, although MODIS generally underestimated reflectivity. Coddington et al. 
(2008) compared the spectral surface albedo derived from the airborne Solar Spectral Flux 
Radiometer (SSFR) with the MODIS albedo product. They centred the analysis over two 
sites (an urban area and a ranchland whose primary vegetation cover was parched grass); 
where in situ albedo measurements were retrieved during the campaign. Their results 
showed a MODIS underestimation of 0.025-0.05 at the urban area and a MODIS over- 
estimation of 0.02-0.05 at the rural area regarding the SSFR results. Liu et al. (2009) 
evaluated the ability of the MODIS albedo product to represent albedos at all diurnal solar 
zenith angles through a comparison with field measurements from the Surface Radiation 
Budget Network (SURFRAD) and Atmospheric Radiation Measurement Southern Great 
Plains (ARM/SGP). They found a high correlation between in situ and satellite albedos for 
almost all cases. They observed negative mean biases, with magnitude increased as solar 
zenith angle increased, meaning that the MODIS algorithm underestimates albedo as com- 
pared with ground measurements. Cescatti et al. (2012) recently compared MODIS albedo 
retrievals with surface measurements taken at 53 FLUXNET sites that met strict conditions 
of land cover homogeneity. They observed good agreement for forest sites. In contrast, in 
the case of non-forest sites with larger albedo values (grasslands and croplands), MODIS 
generally underestimated in situ measurements across the seasonal cycle. 

The goal of this work is to evaluate the MODIS albedo product over a heterogeneous 
agricultural area using in situ albedo measurements in addition to airborne hyperspectral 
imagery. We will analyse two different BRDF models, i.e. on the one hand, the same model 
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as the MODIS product and, on the other, the improvement in this model as proposed by 
Maignan, Breon, and Lacaze (2004) that corrects the hot spot effect. The whole dataset 
presented in this work was acquired during the EODIX field campaign. 

Material and methodology 
Study area and field campaign 

Barrax is located in southeastern Spain, within La Mancha, a plateau 700 m above sea 
level, and it is in the western part of the province of Albacete, 28 km from the city of 
Albacete (39° 3' N, 2° 60' W). The area is characterized by a flat morphology (elevation 
range up to 2 m only) and large, uniform land-use units. The dominant cultivation pattern 
in the 10,000 ha area is approximately 65% dry land (two-thirds winter cereals, one-third 
fallow) and 35% irrigated crops (75% corn, 15% barley, and 10% others, including alfalfa) 
(Moreno et al. 2001). The climate of Barrax is of the Mediterranean type, with heavy 
rainfall in spring and autumn and dry in summer. It presents a high level of continentality, 
with quite sudden changes from cold to warm months and high oscillation in all seasons 
between maximum and minimum daily temperatures. 

Several remote-sensing field campaigns have been carried out over the Barrax test 
site during recent years, such as the SPARC 2004 field campaign (Sobrino et al. 2009), 
which established Barrax as an appropriate site for the calibration/validation process using 
remote-sensing images. This article is focused on the field campaign developed within the 
framework of the EODIX project. It was carried out from the 10th to the 12th of June 2011, 
where extensive in situ and airborne measurements were carried out over several crops and 
natural areas. 

In situ data 

Calibration and validation activities were carried out simultaneously to the airborne over- 
pass. In this article, we distinguish two types of in situ measurements: surface reflectance 
and albedo measurements. On the one hand, surface reflectance was retrieved over dif- 
ferent surface types of the test area in order to obtain sufficient representative spectra. 
A transect concurrent with the airborne overpass, starting 30 min before and ending 
30 min after, was performed with a FieldSpec 3 spectroradiometer (Analytical Spectral 
Devices, Inc., Boulder, CO, USA). In this way, four different fields were characterized: 
bare soil, alfalfa, barley, and green grass. Additionally, a goniometer was placed in a corn 
field with a GER 1500 spectroradiometer (Spectra Vista Corporation, Poughskeepsie, NY, 
USA) (Figure 1(a)). The nadir measurements retrieved during the airborne overpass were 
also considered in the validation. On the other hand, we disposed of albedo measure- 
ments from two albedometers located at two meteorological stations, one in a barley field 
(Figure 1(6)) and the other in a wheat field (Figure 1(c)). Furthermore, angular surface 
reflectance measurements from the goniometer were inverted in order to estimate surface 
albedo. 

Finally, the aerosol optical thickness (AOT) needed in atmospheric correction was 
retrieved with a CE318 sun-photometer (Cimel Electronique S.A.S., Paris, France). The 
CE3 1 8 is a commercial sun-photometer designed for the automatic measurement of direct 
solar irradiance and sky radiance. The unit employed in this campaign was an extended 
version, measuring in channels centred at 340, 380, 440, 500, 670, 870, 940, 1020, and 
1640 nm, with the 940 nm channel being dedicated to obtaining atmospheric columnar 
water vapour. 
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Figure 1. In situ albedo measurements from (a) a goniometer in a corn field, ( b ) an albedometer 
located in a barley field at a meteorological station in a barley field, and (c) an albedometer located 
in a wheat field at a meteorological station. ( d ) AF1S RGB ( red-green-blue ) image (coordinates in 
UTM) and positions of the validation points ( triangles ). 


Airborne data 

The airborne data studied in this work were acquired by the Airborne Hyperspectral 
Scanner (AHS) (Sobrino et al. 2009), which is an 80 band airborne imaging radiometer, 
developed and built by SensyTech Inc. (Beverly, MA, USA) (currently Argon ST, formerly 
DaedalusEnt. Inc.) and operated by the Spanish Institute for Aerospace Technology (INTA). 
It has 63 bands in the reflective part of the electromagnetic spectrum, seven in the 3-5 pm 
range and 10 in the 8-13 pm region. However, our study will be centred on the bands 
equivalent to MODIS. Table 1 shows the equivalence that was considered between the 
sensors. 

The AHS is a line scanner based on a concept shared with classical airborne line scan- 
ners, such as the Airborne Thematic Mapper (ATM), Multispectral Infrared and Visible 
Imaging Spectrometer (MIVIS), and MODIS Airborne Simulator (MAS). The AHS was 
installed in a CASA-212 200 Series aircraft, and integrated with a GPS unit from Applanix 
(Richmond Hill, ON, Canada). 
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Table 1 . Equivalence between AHS and MODIS bands. 


MODIS 

AHS 

Band 1: (645 ± 25) nm 

Band 8: (650 ± 14) nm 

Band 2: (859 ± 18) nm 

Band 15: (856 ± 14) nm 

Band 3: (469 ± 10) nm 

Band 2: (471 ± 14) nm 

Band 4: (555 ± 10) nm 

Band 5: (560 ± 14) nm 

Band 5: (1240 ± 10) nm 

Band 20: (1001 ± 14) nm 

Band 6: (1640 ± 12) nm 

Band 21: (1588 ± 45) nm 

Band 7: (2130±25)nm 

Band 35: (2134 ±45)nm 



Figure 2. Flight lines along the principal plane (blue) and the orthogonal plane (red) over the test 
area, 12 June 2011. 

The data used in this work were acquired in a straight line at an altitude of 2545 m above 
sea level on the 12th of June 2011. The resulting data have a ground spatial resolution of 
4 m. During this campaign, several flights were achieved from 09.00 to 10.00 UTC in order 
to obtain enough bidirectional observations to retrieve the BRDF of the test area. Figure 2 
shows the flight lines carried out. These were planned considering the symmetry of BRDF 
in the orthogonal plane. In order to detect view zenith angles near to 60° during flights, 
a wedge was placed under the AHS, tilting the sensor developed along the furthest flight 
lines in regard to the main area. 


Methodology 

The MCD43A1 MODIS product is estimated using a kernel-based BRDF model (Strahler 
et al. 1999). The theoretical basis of this semi-empirical model is that land surface 
reflectance, p, is modelled as a sum of three kernels (k 0 , k\, and k 2 ) (Equation (1)) 
representing basic scattering types: isotropic scattering, radiative transfer-type volumetric 
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scattering (as from horizontally homogeneous leaf canopies), and geometric-optical surface 
scattering (as from scenes containing three-dimensional objects that cast shadows and are 
mutually obscured from view at off-nadir angles): 

p (6> s , 0y, = k 0 + k\ F\ (0 S , Qy, 4>) + k 2 F 2 (9 S , 6 V , (p), (1) 

where 9 S is the sun zenith angle, 9 V is the view zenith angle, 4> is the relative azimuth 
angle, F \ is the volume-scattering kernel (based on the Rossthick function derived by 
Roujean, Leroy, and Deschamps (1992)), and F 2 is the geometric kernel (based on the 
LiSparse-Reciprocal model (Li and Strahler 1992), but considering the reciprocal form 
given by Lucht (1998)), F\ and F 2 are fixed functions of the observation geometry, but 
k 0 , k\, and k 2 are free parameters. The MCD43 product, which combines Terra and Aqua 
data, is estimated by inverting the BRDF model parameters over a composite period of 
16 days in which the surface is assumed to be stable. In this article, we evaluate the 
RossThick-LiSparse-Reciprocal (RTLSR) BRDF model, which is the model considered 
in the MCD43 MODIS product, and the same model but corrected for the hot spot process, 
as proposed by Maignan, Breon, and Lacaze (2004) (RTLSR-HS). 

The albedo is derived by integrals of the BRDF model through the black-sky albedo 
(a bs ) and the white-sky albedo (a ws ): 

a bs (0,A) = £/*(A)A*(0), (2) 

k 

a ws (A) = jy k (A)H k , (3) 

k 

where 0 is the solar zenith angle, A is the wavelength,^ is the BRDF kernel model, 

/»2 JT /» tt /2 

hk (6) = / / Kk{6, 9, 4>) sin 9 cos fid#, and (4) 

Jo Jo 

f*/ 2 

Hj, = 2 / hk ( 6 ) sin 9 cos 9 d 9, (5) 

Jo 

where K/ { are the kernel parameters, fi is the view zenith angle, and <p is the relative azimuth. 
By interpolating between black-sky and white-sky albedo quantities, the following equation 
can be used to compute MODIS blue-sky (or actual or instantaneous) albedo, a: 

a ( 9 , A) = [1 — £ (9, r (A))] a bs {9, A) + 5 ( 9 , r (A)) a ws (A) , (6) 

where S is the fraction of diffuse skylight that depends on aerosol optical depth r and on 
wavelength A. This parameter was derived from 6S for each airborne image. 

Finally, the spectral to broadband conversion was achieved following Liang (2001), 
which in the particular case of MODIS is written as 


“broadband = 0.160fl!i + 0.291a2 + 0.243a3 + 0.116«4 + 0.112a5 + 0.081a7 — 0.0015, 


where a, is the blue-sky albedo for band i. 

In this article, we first corrected atmospherically the airborne images with the radia- 
tive transfer code 6S (Vermote et al. 2006) before deriving BRDF. Next, we obtained 
the white-sky albedo, the black-sky albedo and, with the fraction of diffuse skylight, the 
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blue-sky albedo. Next, we estimated the blue-sky broadband albedo, which was evalu- 
ated with in situ measurements. In addition, since the MCD43A1 MODIS product consists 
of the BRDF parameters, we derived the blue-sky broadband albedo following the same 
methodology as for airborne data and considering the same angular conditions. Finally, we 
compared airborne images with MODIS blue-sky broadband albedo images. 
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Results 

Atmospheric correction 

First, airborne images were atmospherically corrected with 6S. We corrected only AF1S 
bands equivalent to MODIS bands (Table 1). Surface reflectance images were tested with 
in situ measurements. A total of five different surfaces were taken into account: corn, bare 
soil, alfalfa, barley, and green grass. Since each surface was observed by AHS at differ- 
ent angles and in situ measurements were retrieved at nadir, we considered only airborne 
images that observed each validation point with view zenith angles lower than 25°. Figure 3 
shows airborne versus in situ surface reflectance, taking into account every flight (for this 
condition) and every surface. In this graph, singular in situ values present different airborne 
estimations and, beyond these, the points most dispersed correspond to higher view zenith 
angles. Table 2 shows the bias, standard deviation, and RMSE. 


Airborne albedo estimation 

Once tested, we obtained the BRDF from the surface reflectivity airborne images. First, 
we georeferenced every image and extracted the common area for every image. Then, we 
inverted the models by using a least-squares method, followed by estimation of white- and 
black-sky albedo following Equations (2) and (3). Since black-sky albedo depends upon 
the solar zenith angle, each airborne image had a different black-sky albedo but the same 
white-sky albedo. Finally, with the fraction of diffuse skylight, we derived the blue-sky 
albedo following Equation (4) and transferred from narrow to broadband albedo follow- 
ing Liang (2001). Figure 1 {d) shows the position of the three validation points considered: 
two meteorological stations (one in a barley field and the other in a wheat field) and a 
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Figure 3. Airborne surface reflectance testing of in situ measurements for bands 1 to 7 (B1-B7). 
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Table 2. Statistics when testing surface reflectance airborne images with in situ data. 



Bias 

Standard deviation 

RMSE 

Band 8 (MODIS Band 1) 

0.020 

0.019 

0.030 

Band 15 (MODIS Band 2) 

0.015 

0.020 

0.030 

Band 2 (MODIS Band 3) 

0.017 

0.009 

0.020 

Band 5 (MODIS Band 4) 

-0.006 

0.013 

0.014 

Band 20 (MODIS Band 5) 

0.012 

0.020 

0.030 

Band 21 (MODIS Band 6) 

-0.004 

0.020 

0.020 

Band 35 (MODIS Band 7) 

0.007 

0.019 

0.020 


goniometer in a corn field. Figure 4 shows the airborne versus in situ blue-sky albedo 
broadband estimation. Since we disposed of eight different flights that were performed over 
1 hour (09.00-10.00 UTC), we averaged the albedo obtaining three different measurements 
representing the albedo corresponding to the times 09.00, 9:30, and 10.00. We must empha- 
sise that the albedo of the corn field, which was derived from the goniometer, corresponds 
to the visible blue-sky albedo, since the GER radiometer (used in the goniometer) does not 
cover wavelenghts greater than 1 500 nm. Thus, it was compared with the airborne visible 
blue-sky albedo. Additionally, the in situ corn albedo was estimated with both models. From 
the plot, we observed that both models yielded similar results, with high correlation coef- 
ficients showing good agreement between airborne and in situ albedo values. The worst 
correlation was found for the barley field, where both models underestimated the in situ 
measurement. The greatest difference between the models was for the corn field. While the 
RTLSR-HS model provided good estimation, the RTLSR model underestimated it slightly. 
Finally, both RTLSR and the RTLSR-F1S models yielded an RMSE of 0.018. 


Aggregation 

After testing AHS albedo images, we aggregated them into the MODIS spatial resolu- 
tion (500 m). We assumed a linear average of the high-resolution AE1S image in order to 



In situ albedo 


Figure 4. Results of the albedo test carried out in the corn (circles), wheat (squares), and barley 
(triangles) fields. 
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compare both products directly. Figure 5 shows an example of the difference between AF1S 
and MODIS resolutions and the location of the MODIS nearest pixels to in situ albedo 
measurements. The equivalence between the MODIS pixels over the AHS image shows 
that in the case of the barley field, the MODIS pixel was homogeneous, while in the case of 
the wheat and corn fields, they were heterogeneous. Figure 6 represents the albedo derived 
from the MODIS product versus that estimated from AF1S images for these pixels. First, we 
observed that the MODIS albedo did not change significantly between each surface. In the 
case of the AHS albedo derived from the RTLSR BRDF model, the difference between each 
pixel is lower than that in the RTLSR-HS model. Second, the MODIS albedo estimations 
were higher than AHS albedos. The greatest difference between the albedo estimated from 
the RTLSR-HS model and the MODIS product was found in the corn field pixel, which was 
the most heterogeneous (as shown by the error bars in the plot). The RMSE obtained by 
comparing AHS to the MODIS albedo product was 0.04 for both models. Third, in regard 
to the barley field, whose MODIS pixel was homogeneous, the in situ and satellite albe- 
dos were comparable (MODIS and in situ albedo measurements were 0.210 ± 0.003 and 
0.204 ± 0.003, respectively. This individual case shows that the MODIS product presents 
good agreement with in situ data in regard to a homogeneous pixel. 


Discussion and conclusion 

The aim of this study was to evaluate the MODIS BRDF/Albedo product over a heteroge- 
neous agricultural area in the framework of the EODIX campaign. In this way, we applied 
two BRDF models to AHS airborne data, the RTLSR and the RTLSR-HS, to obtain the 
surface albedo. The results show good agreement between the RTLSR model (MODIS 
BRDF/Albedo product algorithm) and the RTLSR-HS model when compared to in situ 
data, with an RMSE of 0.0 1 8 in both cases. However, we observed a slight underestimation 
(more significant in the corn field by the RTLSR model and in the barley field by both mod- 
els), which has been already reported in previous works such as Roesch, Schaaf, and Gao 
(2004) and Liu et al. (2009). In fact, we observed that the com field (in its growth phase in 
June) and the wheat field (beginning its senescent phase) showed a better agreement with 
in situ data than the barley field (senescent). These facts accord with Jin et al. (2003), who 
observed good results during the growing season but also observed underestimation during 
other seasons. 



Figure 5. Blue-sky broadband albedo (a) AHS image using the RTLSR model and ( b ) MODIS 
image. The red squares over the AHS image show the equivalent area over MODIS data. 
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Figure 6. Comparison between MODIS and AHS albedo for the nearest pixel to the corn {circles), 
wheat {squares), and barley ( triangles ) fields. 


Regarding the comparison between airborne and satellite data, the aggregation of AHS 
pixels yielded an RMSE of 0.04 for both models. This error is not simply a consequence of 
the aggregation technique, but is also due to the methodology applied to estimate BRDF. 
We must take into account that the MODIS BRDF /albedo algorithm considers that the 
surface does not change over 16 days, which is a coarse approach when working with agri- 
cultural sites near their senescent period. However, the AHS data correspond to a single-day 
composition. Additionally, we must emphasize the difficulty in comparing satellite to air- 
borne or in situ data during this study because of the heterogeneity present. Nevertheless, 
since airborne images showed good agreement with in situ data, the RMSE of 0.04 proves 
that MODIS BRDF/albedo product meets the required accuracy of 0.02-0.05 in sur- 
face albedo estimation. Additionally, in regard to a homogeneous pixel (barley field), we 
found good agreement between satellite estimation (0.210 ± 0.003) and in situ albedo 
measurement (0.204 ± 0.003). 

This article shows that RTFSR and the RTFSR-HS models provide equivalent results. 
The key difference between both models is in the hot spot region where we did not dispose 
of in situ measurements. Therefore, both models can be used in future studies in albedo 
estimation, but precision may be slightly enhanced by using RTFSR-HS. 
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